Image capturing apparatus and method for controlling the same, image stabilization apparatus and method for controlling the same, and lens unit

ABSTRACT

An image capturing apparatus comprising: an image sensor that shoots a subject image that is incident thereon via an imaging optical system; a setting unit that sets a background flow amount in panning shooting; a calculation unit that calculates, in panning shooting, an exposure period of exposing the image sensor from the background flow amount, an angular velocity detected by a detection unit that detects an angular velocity of vibration, and a focal length of the imaging optical system, so as to obtain the background flow amount set by the setting unit; and a limitation unit that, if the exposure period calculated by the calculation unit is greater than or equal to a predetermined threshold value, limits the exposure period to the threshold value.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a divisional of application Ser. No. 15/414,732,filed Jan. 25, 2017 the entire disclosure of which is herebyincorporated by reference.

BACKGROUND OF THE INVENTION Field of the Invention

The present invention relates to an image capturing apparatus and amethod for controlling the image capturing apparatus, an imagestabilization apparatus and a method for controlling the imagestabilization apparatus, and lens unit.

Description of the Related Art

Conventionally, image capturing apparatuses capable of panning shootingare known. Panning shooting refers to a technique of shooting, in a casewhere a subject is moving at a certain speed, an image in which thebackground flows while the subject appears to not be moving, by exposingthe image while panning an image capturing apparatus so as to follow themovement of the subject. In panning shooting, usually, shooting isperformed at a slow shutter speed so as to express a sense of dynamicityin the subject.

However, skill is required to follow a subject (e.g. a train that ismoving at 60 km/h) well while panning the camera at a slow shutter speed(e.g. 1/30 seconds) to shoot the subject. In particular, for beginners,it is difficult to adjust the camera panning speed to the subject speedduring an exposure period at a slow shutter speed, which is why panningshooting is a difficult shooting technique. To enable such panningshooting to be readily performed, a method using an image stabilizationapparatus is known.

In general, a good example of a pan shot is an image in which a subjectstands still while the background flows in a direction opposite to themoving direction of the subject. To shoot such an image in which asubject stands still, Japanese Patent Laid-Open No. 2006-317848discloses a method in which the difference between the subject speed andthe camera panning speed is detected, and correction is performedaccording to the shift amount corresponding to this difference, using animage stabilization function. With this method, immediately beforeshooting, the angular velocity of the camera that is following thesubject during the panning (or tilting) is detected by an angularvelocity sensor in the camera. Simultaneously, the moving amount of amain subject image on an imaging plane is detected. The angular velocityof the subject is calculated from the detected panning speed and movingamount of the subject image on the imaging plane. During exposure, animage stabilization operation is performed in accordance with the amountof difference between the calculated angular velocity of the mainsubject and the output from the angular velocity sensor in the camera.Thus, the vibration amount and the difference between, the speed of themain subject and the camera panning speed are corrected, which enablessuppression of image blur of the main subject subjected to panningshooting.

Japanese Patent Laid-Open No. 2015-161730 discloses an imagestabilization apparatus that causes timing of the output of the movingamount of a subject image on an imaging plane and the output from avibration detection unit to coincide with each other, and improves theaccuracy of detection of the angular velocity of the subject. JapanesePatent Laid-Open No. 2015-102774 discloses a photographic apparatus thatdetermines a shutter speed to be used when capturing an image of subjectlight with an image sensor based on an angular velocity and a focallength.

It is, however, difficult for a beginner to set a correct shutter speedfor shooting an image in which the background flows icy an appropriateamount in a direction opposite to the moving direction of the subject.This can be comprehended from experience because the shutter speed isdetermined based on the subject speed, the focal length of the imaginglens, the shooting distance from the subject, and the panning (ortilting) speed of the photographer.

If the shutter speed is too fast, the subject is less likely to blur butthe background does not flow, resulting in the subject appearing lessdynamic, and an obtained image may not be satisfactory when consideredas an exemplary work of panning shooting. On the other hand, if theshutter speed is too slow, the background flows but the exposure periodbecomes long, thus the subject is likely to blur due to a camera shake,which results in an increase in the likelihood of failing the panningshooting.

In addition, Japanese Patent Laid-Open No. 2015-161730 does not disclosean assist function for setting an exposure period when panning shootingis performed. For this reason, it is difficult for a photographer who isnot used to panning shooting to calculate an appropriate exposure periodto obtain an intended flow amount. In the image capturing apparatusdisclosed in Japanese Patent Laid-Open No. 2015-102774, consideration isnot given to variation in speed in the same subject. For example, whenshooting a running animal, a part of the subject may flow in theobtained image depending on the settings. This phenomenon occurs when afast-moving portion exists in the subject and a long exposure period isset relative to the moving speed of this portion, and the image shot atthis time may lose its ambience brought out by panning shooting.

SUMMARY OF THE INVENTION

The present invention has been made in consideration of the abovesituation, and enables even a photographer who is not used to panningshooting to readily set a shutter speed at which a panning shootingeffect can be obtained.

According to the present invention, provided is an image capturingapparatus comprising: an image sensor that shoots a subject image thatis incident thereon via an imaging optical system; a setting unit thatsets a background flow amount in panning shooting; a calculation unitthat calculates, in panning shooting, an exposure period of exposing theimage sensor from the background flow amount, an angular velocitydetected by a detection unit that detects an angular velocity ofvibration, and a focal length of the imaging optical system, so as toobtain the background flow amount set by the setting unit; and alimitation unit that, if the exposure period calculated by thecalculation unit is greater than or equal to a predetermined thresholdvalue, limits the exposure period to the threshold value.

Further, according to the present invention, provided is a method forcontrolling an image capturing apparatus during panning shooting usingan image sensor for shooting a subject image that is incident thereonvia an imaging optical system, the method comprising: setting abackground flow amount; calculating an exposure period of exposing theimage sensor from the background flow amount, an angular velocitydetected by a detection unit that detects an angular velocity ofvibration, and a focal length of the imaging optical system, so as toobtain the set background flow amount; and if the calculated exposureperiod is greater than or equal to a predetermined threshold value,limiting the exposure period to the threshold value.

Furthermore, according to the present invention, provided is an imagestabilization apparatus comprising: a calculation unit that calculates amotion vector of a subject included in an image; an acquisition unitthat acquires a focal length; and a control unit that controls anexposure period based on the motion vector of the subject, vibrationinformation detected by a detection unit, and the focal length.

Further, according to the present invention, provided is an imagecapturing apparatus comprising: an image sensor that performsphotoelectric conversion on an optical image formed via an imagingoptical system, and output image data; a calculation unit thatcalculates a motion vector of a subject included in an imagecorresponding to the image data; an acquisition unit that acquires afocal length; and a control unit that controls an exposure period basedon the motion vector of the subject, vibration information detected by adetection unit, and the focal length.

Further, according to the present invention, provided is a lens unitcomprising: an imaging optical system; a calculation unit thatcalculates a motion vector of a subject included in an image acquiredvia the imaging optical system a detection unit configured to detectvibration information; an acquisition unit configured to acquire a focallength; and a control unit configured to control an exposure periodbased on the motion vector of the subject, the vibration information,and the focal length.

Further, according to the present invention, provided is a method forcontrolling an image stabilization apparatus comprising: calculating amotion vector of a subject included in an image; detecting vibrationinformation; acquiring a focal length; and controlling an exposureperiod based on the motion vector of the subject, the vibrationinformation, and the focal length.

Further, according to the present invention, provided is a storagemedium storing a program for causing a computer to execute processingfor: calculating a motion vector of a subject included in an image;detecting vibration information; acquiring a focal length; andcontrolling an exposure period based on the motion vector of thesubject, the vibration information, and the focal length.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments (with reference to theattached drawings).

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate embodiments of the invention, andtogether with the description, serve to explain the principles of theinvention.

FIG. 1 is a block diagram showing a functional configuration of an imagecapturing apparatus according to a first embodiment of the presentinvention;

FIG. 2 is a block diagram showing a functional configuration of an imagestabilization system according to the first embodiment;

FIGS. 3A and 3B show a control flowchart at the time of shootingaccording to the first embodiment;

FIG. 4 is a flowchart of shutter speed calculation processing whenpanning shooting is performed according to the first embodiment;

FIG. 5 is a diagram for illustrating a relationship between an angularvelocity and a shutter speed with respect to a background flow amountaccording to the first embodiment;

FIG. 6 is a diagram for illustrating a driving range of an imagestabilization unit according to the first embodiment;

FIG. 7 is a flowchart showing a method for controlling an imagecapturing apparatus according to a second embodiment;

FIG. 8 is a block diagram of an image capturing apparatus according tothe second embodiment;

FIG. 9 is a block diagram showing an image stabilization control unitaccording to the second embodiment;

FIG. 10 is an illustrative diagram of axes and directions of the imagecapturing apparatus according to the second embodiment;

FIGS. 11A to 11C are illustrative diagrams of motion vectors accordingto the second embodiment;

FIG. 12 is a flowchart showing a method for calculating a driving amountof an image stabilization lens according to the second embodiment; and

FIG. 13 is a flowchart showing an exposure; control method according tothe second embodiment.

DESCRIPTION OF THE EMBODIMENTS

Exemplary embodiments of the present invention will be described indetail in accordance with the accompanying drawings.

FIG. 1 is a block diagram showing a functional configuration of an imagecapturing apparatus that includes an image stabilization systemaccording to an embodiment of the present invention. Although thisembodiment will describe, as an image capturing apparatus, a digitalcamera capable of shooting a still image, the present invention is notlimited to a digital camera and is also applicable to photographicapparatuses such as a monitoring camera, a web camera, and a cellularphone.

In FIG. 1, an imaging optical system is configured to include a zoomunit 151 that includes a zoom lens for changing a magnification ratio, adiaphragm/shutter unit 153, an image stabilization unit 112, and afocusing unit 157 that includes a lens for adjusting focus. The zoomunit 151 is controlled and driven by a zoom drive control unit 152, thediaphragm/shutter unit 153 is controlled and driven by adiaphragm/shutter drive control unit 154, and the focusing unit 157 iscontrolled and driven by a focusing drive control unit 158.

An image stabilization system drive unit 111 is a voice coil motor fordriving the image stabilization unit 112 which is driven by the imagestabilization system drive unit 111 to move in a direction perpendicularto the optical axis. An image stabilization system position detectionunit 113 is constituted by a magnet and a Hall sensor provided at aposition opposing the magnet, detects a moving amount of the imagestabilization unit 112 in a direction perpendicular to the optical axis,and supplies the detection result to a subtracter 108 via an A/Dconverter 114. The image stabilization unit 112 is a shift lens, forexample, and is a correction system that shifts the optical axis bybeing moved in a direction perpendicular to the optical axis and enablesoptical image stabilization. Otherwise, an imaging unit 159 may be movedin a direction perpendicular to the optical axis. As a result, an imagein which movement of a subject on an imaging plane due to a shake of theapparatus or the like has been corrected is formed on the imaging unit159.

The imaging unit 159 performs photoelectric conversion on a subjectimage that is incident via the aforementioned imaging optical systeminto an electric signal. The electric signal output from the imagingunit 159 is subjected to conversion processing and converted into avideo signal by an image signal processing unit 160, and, according tothe purpose, is further processed by a video signal processing unit 161.A display unit 162 displays an image, as necessary, based on the signaloutput from the video signal processing unit 161.

A power supply unit 163 supplies power to the overall image capturingapparatus according to the purpose. An external input/output terminalunit 164 inputs and outputs a communication signal and a video signalto/from an external apparatus (not shown).

An operation unit 165 is used to operate the system, and includes animage stabilization ON/OFF switch, a shutter release button, a movingimage recording switch, a reproduction mode selection switch, amagnification changing switch, and a panning shooting mode settingswitch.

The image stabilization ON/OFF switch enables shake correction to beselectively turned on and off, and, upon image stabilization beingturned on by the image stabilization ON/OFF switch, a camera systemcontrol unit 168 instructs the image stabilization system drive unit 111to perform an image stabilization operation. Upon receiving thisinstruction, the image stabilization system drive unit 111 performs theimage stabilization operation until an instruction to turn off imagestabilization is given.

The shutter release button is configured to enable two-step operation,i.e. such that a first switch (SW1) and a second switch (SW2) turn on inthis order in accordance with a pressing amount. The shutter releasebutton has a structure in which the first switch SW1 turns on when theshutter release button is roughly half-pressed (first step), and thesecond switch SW2 turns on when the shutter release button is fullypressed (second step). Upon the first switch SW1 turning on, the focusdrive control unit 158 drives the focusing unit 157 to adjust the focus,and the diaphragm/shutter drive control unit 154 drives thediaphragm/shutter unit 153 to set an appropriate exposure. Upon thesecond switch SW2 turning on, image data obtained from an optical imageexposed on the imaging unit 159 is stored in a storage unit 166.

Moving image shooting is started upon a moving image recording switchbeing pressed, and the recording ends upon the switch being pressedagain during the recording. Still image shooting during recording of amoving image is also possible by pressing the first switch SW1 and thesecond switch SW2 during the shooting of the moving image.

Upon the reproduction mode selection switch being pressed, areproduction mode is selected. Note that the image stabilizationoperation stops when in the reproduction mode.

The magnification changing switch is a switch for giving an instructionto change the zoom magnification ratio. Upon an instruction to changethe zoom magnification ratio being given by the magnification changingswitch, the zoom drive control unit 152 that has received theinstruction via the camera system control unit 168 drives the zoom unit151 and moves the zoom unit 151 to a zoom position designated in theinstruction. Also, the focus drive control unit 158 drives the focusingunit 157 to adjust the focus based on image information that has beensent from the imaging unit 159 and processed by the image signalprocessing unit 160 and the video signal processing unit 161.

The panning shooting mode setting switch enables a panning shooting modeto be selectively turned on and off, and, upon panning shooting beingselected, an image stabilization operation suitable for panning shootingand a shutter speed suitable for panning shooting are set.

The storage unit 166 stores various data such as picture information. Anangular velocity detection unit 102 is an angular velocity sensor thatuses a sensor such as a gyro sensor to detect, as an angular velocity,the amount of vibration applied to the camera, and outputs a vibrationsignal (angular velocity data) obtained by converting the detectedangular velocity into a voltage. The camera system control unit 168controls the overall image capturing apparatus. A motion vectordetection unit 116 detects motion vectors in an image based on aluminance signal included in a current video signal generated by theimage signal processing unit 160, and a luminance signal included in avideo signal of the immediately previous frame.

FIG. 2 is a block diagram showing a functional configuration of theimage stabilization system mounted in the digital camera shown inFIG. 1. Note that the following description will be given of imagestabilization control in either one of the yaw direction and the pitchdirection of an image, and a description of image stabilization controlin the other direction, which is performed similarly, will be omitted.

The angular velocity data output from the angular velocity detectionunit 102 is supplied to a high pass filter (HPF) 103 within a μCOM 101configured in the camera system control unit 168. The HPF 103 has afunction capable of changing the characteristics in any frequency band,cuts off low frequency components included in the angular velocity data,and thereafter outputs a signal in a high frequency band. Note that,instead of providing the HPF 103, a configuration may be employed inwhich a signal obtained by passing the output from the angular velocitydetection unit 102 through a low pass filter (LPF) for cutting off asignal in a high frequency band is subtracted from the output from theangular velocity detection unit 102.

A gain/phase characteristic calculation unit 104 is constituted by anamplifier for amplifying the output from the HPC 103, with a given gain,and a phase compensation filter.

A focal length calculation unit 105 calculates a focal length of theimaging optical system from zoom information that indicates a state ofthe zoom lens output from the zoom drive control unit 152, and correctsthe output from the gain/phase characteristic calculation unit 104 so asto obtain an optimum value for driving the image stabilization unit 112.

Meanwhile, the motion vectors output from the motion vector detectionunit 116 are supplied to a subject vector detection unit 117. Also, anon-imaging plane moving amount on the imaging plane that is obtained byconverting an angular velocity obtained as a result of an offsetelimination unit 115 eliminating an offset component from the outputfrom the angular velocity detection unit 102 is input to the subjectvector detection unit 117. The motion vectors in the image are thenseparated into subject vectors and background vectors by using the inputon-imaging plane moving amount. Note that the offset elimination unit115 may use, as the offset component, the average value of the output ofthe angular velocity detection unit 102 in a case where the camera is ina stationary state, or may use a value obtained by converting abackground vector in the immediately previous frame detected by thesubject vector detection unit 117 into an angular velocity. As a methodfor separating the motion vectors into subject vectors and backgroundvectors, for example, known methods such a the method described inJapanese Patent Laid-Open No 2015-161730 are available.

A subject angular velocity calculation unit 118 converts each of thesubject vectors, which is the output from the subject vector detectionunit 117, into a subject angular velocity by using information regardinga frame rate and the focal length included in the zoom information. Asubtracter 119 subtracts the angular velocity of the image stabilizationapparatus, which is the output from the offset elimination unit 115,from the subject angular velocity calculated by the subject angularvelocity calculation unit 118, i.e. calculates a differential angularvelocity between the subject and the camera.

A switch 106 for selecting a target signal for the image stabilizationunit 112 switches between the output from the focal length calculationunit 105 and the output from the subtracter 119, based on informationregarding ON/OFF of the panning shooting mode selected by using thepanning shooting mode setting switch in the operation unit 165. If thepanning shooting mode is ON, the switch 106 performs later-describedsubject blur correction, in which an output signal of the subtracter 119is supplied to an integrator 107 to correct a blur of the subject. Onthe other hand, if the panning shooting mode is OFF, the switch 106performs image stabilization, in which the output from the focal lengthcalculation unit 105 is supplied to the integrator 107 to correct a blurfor the entire image.

Note that a configuration may be employed in which it is determinedwhether the panning shooting mode is ON or OFF by comparing the outputregarding the yaw direction and the output regarding the pitch directionfrom the angular velocity detection unit 102, rather than through thesetting of the panning shooting mode setting switch. In this case, forexample, if the output regarding one axis from the angular velocitydetection unit 102 is larger than the output regarding the other axisfrom the angular velocity detection unit 102 (e.g. by 10 dps or more),it is determined that the camera is in a panning (or tilting) state andthe panning shooting mode is ON. Note that, even in the panning shootingmode, if later-described subject vectors cannot be detected, the switch106 is controlled so as to select the output from the focal lengthcalculation unit 105.

The integrator 107 has a function capable of changing thecharacteristics in any frequency band, integrates the output from theswitch 106, and calculates a driving amount of the image stabilizationunit 112.

The subtracter 108 subtracts, from the output from the integrator 107,digital data that is obtained as a result of the A/D converter 114performing A/D conversion on a signal indicating the position of theimage stabilization unit 112 output from the image stabilization systemposition detection unit 113, and supplies the result to a controller109.

The controller 109 is constituted by an amplifier that amplifies inputdata with a given gain, and a phase compensation filter. Deviation datathat is supplied from the subtracter 108 is subjected to signalprocessing by the amplifier and the phase compensation filter in thecontroller 109, and is thereafter output to a pulse width modulationunit 110.

The pulse width modulation unit 110 modulates the supplied data that haspassed through the controller 109 into a waveform for changing the dutyratio of a pulse wave (i.e. a PWM waveform), and supplies the waveformto an image stabilization system drive unit 111.

Next, a description will be given of a method for setting a shutterspeed (exposure period) during panning shooting. The shutter speedduring panning shooting is obtained by Equation (1) below.

Tv=α/(f×ω)  (1)

Here, Tv denotes a shutter speed, f denotes a focal length, ω denotes anangular velocity, and α denotes a background flow amount.

The denominator on the right-hand side in Equation (1) is a product ofthe focal length f of the imaging lens and the angular velocity ω of thecamera, and this value indicates a background flow speed on the imagingplane. The shutter speed Tv during panning shooting is calculated suchthat the background flow amount is always fixed independent of theangular velocity ω of the camera. In this embodiment, the backgroundflow amount α can be changed through the operation unit 165 on a screenof the display unit 162 such that a photographer can set the backgroundflow amount. This is because, for example, some photographers mayconsider 100 pixels to be an optimum background flow amount whereasother photographers may consider 300 pixels to be optimum, and even ifphotographers have a different preference of the background flow amount,a background flow amount corresponding to the preference can be set.

Next, a control flow during panning shooting according to the firstembodiment will be described using FIGS. 3A and 3B.

Initially, in step S101, whether or not image stabilization is ON isdetermined, and the processing proceeds to step S102 if imagestabilization is ON, and proceeds to step S119 if image stabilization isnot ON. In step S102, as mentioned above, whether or not the panningshooting mode is ON is determined, and the processing proceeds to stepS103 if the panning shooting mode is ON, and proceeds to step S112 ifthe panning shooting mode is not ON.

In step S103, motion vectors throughout the entire image are detected bythe motion vector detection unit 116. Next, in step S104, an averagevalue of angular velocities between the barycenters of exposure periodsof two frames is acquired from the angular velocities that are theoutput from the angular velocity detection unit 102. Here, the averagevalue of the angular velocities between the barycenters of the exposureperiods is obtained because the motion vector detection unit 116 detectsinter-frame difference vectors between the barycenters of the exposureperiods when capturing an image. Thus, in later-described step S107, theoutput from the motion vector detection unit 116 and an on-imaging planemoving amount on the imaging plane calculated from the output from theangular velocity detection unit 102 can be synchronized with each otherwhen creating a histogram thereof.

In step S105, an offset component is eliminated from the average valueof the angular velocities between the barycenters of the exposureperiods obtained in step S104. The reason for eliminating the offsetcomponent is to prevent, in the later-described subject vectorcalculation, erroneous detection of a subject vector as a result of theon-imaging plane moving amount obtained by converting the angularvelocity being offset due to a superimposed offset component. In stepS106, the average value of the angular velocities between thebarycenters of the exposure periods from which the offset component hasbeen eliminated in step S105 is converted into an on-imaging planemoving amount on the imaging plane by using the information regardingthe frame rate and the focal length.

Next, in step S107, a histogram is created from the motion vectorsdetected in step S103. For example, if a setting is configured in whichthe number of detection blocks to be used by the motion vector detectionunit 116 is six in the vertical direction and ten in the horizontaldirection, a histogram constituted by a total of 60 motion vectors iscreated. The on-imaging plane moving amount on the imaging planecalculated in step S106 is used for creating the histogram. Here, sinceone piece of angular velocity data is acquired in one frame, a fixedrange (e.g. ±10 pix) from the on-imaging plane moving amount on theimaging plane obtained by converting the angular velocity, is set as athreshold value for the background area.

In step S108, whether or not subject vectors can be detected isdetermined from the histogram created in step S107. If subject vectorscan be detected, the processing proceeds to step S109, and if subjectvectors cannot be detected, the processing proceeds to step S112.

Next, in step S109, vectors within the fixed range from the on-imagingplane moving amount on the imaging plane calculated in step S106 are setas candidate background vectors, and vectors outside the fixed range areset as candidate subject vectors. Vectors near a vector with the highestfrequency among the candidate subject vectors are set as the subjectvectors, and an average value thereof is calculated. In step S110, thesubject angular velocity calculation unit 118 converts the subjectvector calculated in step S109 into a subject angular velocity by usingthe information regarding the frame rate and the focal length, and thesubtracter 119 subtracts therefrom the angular velocity of the imagestabilization apparatus that is the output from the offset eliminationunit 115. In step S111, the subject angular velocity calculated in stepS110 is integrated to calculate a correction signal for subject blurcorrection.

On the other hand, in step S112, the panning shooting mode is not set,or even if the panning shooting mode is set, subject vectors cannot bedetected, and therefore, an angular velocity is acquired from theangular velocity detection unit 102 in order to perform normal imagestabilization. Note that, in step S104, the average value of the angularvelocities between the barycenters of the exposure periods is acquired,whereas, in step S112, the angular velocity is acquired in a certaininterrupt cycle (e.g. 4-kHz sampling rate), rather than using theaverage of the angular velocities between the barycenters of theexposure periods.

In step S113, since an offset component is superimposed on the outputfrom the angular velocity detection unit 102, the offset component iseliminated through the HPF 103. Next, in step S114, the output from theangular velocity detection unit 102 from which the offset component hasbeen eliminated is processed by the gain/phase characteristiccalculation unit 104 that is constituted by the phase compensationfilter and the amplifier that performs amplification with a given gain,such that the output has a desired frequency characteristic.

In step S115, the focal length of the imaging optical system iscalculated by the focal length calculation unit 105, and the output fromthe gain/phase characteristic calculation unit 104 is corrected suchthat the output is an optimum value for driving the image stabilizationunit 112, In step S116, the value calculated in step S115 is integrated,and a correction signal for image stabilization is calculated. Next, instep S117, whether or not the panning shooting mode is ON is againdetermined, and the processing proceeds to step S118 if the panningshooting mode is ON, and proceeds to step S119 if the panning shootingmode is not ON.

Next, in step S118, an optimum shutter speed during panning shooting iscalculated. Note that details of this processing will be described laterwith reference to a flowchart in FIG. 4.

In step S119, whether or not the photographer has pressed the shutterrelease button is determined. If the shutter release button has beenpressed, the processing proceeds to step S120, and if the shutterrelease button has not been pressed, the processing returns to step S101and the above processing is repeated.

On the other hand, in step S120, the image stabilization system isdriven in accordance with the determination in step S108, based on thesubject blur correction signal calculated in step S111 or the imagestabilization signal calculated in step S116. In step S121, exposure isperformed at the shutter speed during panning shooting calculated instep S118 in a case of the panning shooting mode, or otherwise at ashutter speed based on an exposure value obtained through normalphotometric processing in other cases, and the shooting processing ends.

Next, processing for calculating the shutter speed during panningshooting performed in step S118 will be described with reference to aflowchart in FIG. 4.

Initially, in step S201, an angular velocity is acquired from theangular velocity detection unit 102. The angular velocity at the time ofcalculating the shutter speed may be the average value of the angularvelocities between the barycenters of the exposure periods as in stepS104, or may be the angular velocity acquired in a certain interruptcycle (e.g. 4-kHz sampling rate) as in step S112. An offset component issuperimposed on the angular velocity detected in step S201, and thesuperimposed offset component will cause an error in the shutter speedcalculation, and therefore, in step S202, the offset component iseliminated as in step S105 or step S113.

In step S203, the focal length is acquired from the zoom information. Instep S204, determination is made regarding a set value of the backgroundflow amount. In this embodiment, there are three types of backgroundflow amounts (small/medium/large), and the photographer sets abackground flow amount on the screen of the display unit 162 by usingthe operation unit 165 before shooting. If the medium background flowamount is set, the processing proceeds to step S205, and if a backgroundflow amount other than medium is set, the processing proceeds to stepS206. Note that, although three types of background flow amounts are setin this embodiment, naturally four or more types (multiple levels) maybe set, or an arbitrary value may be set as the background flow amount.In step S205, since the medium background flow amount is set, thebackground flow amount α is set to α1 (e.g. on-imaging plane movingamount on the imaging plane=100 pix).

In step S206, whether or not the small background flow amount is set isdetermined. If the small background flow amount is set, the processingproceeds to step S207, and if the small background flow amount is notset (i.e. large background flow amount is set), the processing proceedsto step S208. In step S207, since the small background flow amount isset, the background flow amount α is set to α2 (e.g. on-imaging planemoving amount on the imaging plane=70 pix) such that the on-imagingplane moving amount on the imaging plane is smaller than the case of themiddle background flow amount.

In step S208, since the large background flow amount is set, thebackground flow amount α is set to α3 (e.g. the on-imaging plane movingamount on the imaging plane=300 pix) such that the on-imaging planemoving amount on the imaging plane is larger than in the case of themiddle background flow amount.

In step S209, the shutter speed Tv during panning shooting is calculatedbased on Equation (1) such that the background flow amount is always α,regardless of the panning (or tilting) speed.

In step S210, whether or not the shutter speed Tv calculated in stepS209 is smaller than a preset threshold value β (e.g. 1/15 seconds) isdetermined. If the shutter speed Tv is smaller than the threshold value,the processing proceeds to step S212, and if the shutter speed Tv isgreater than or equal to the threshold value, the processing proceeds tostep S211. If the shutter speed Tv calculated in step S209 is greaterthan or equal to the threshold value β, it indicates that the exposureperiod is relatively long. For example, in a case of a long exposure forone second or longer, the risk of a camera shake occurring during theexposure period increases, and therefore, in step S211, the calculatedshutter speed Tv is limited to a low-speed limit value (threshold valueβ).

FIG. 5 shows the relationship between the angular velocity ω and theshutter speed Tv with respect to the aforementioned background flowamounts α1, α2, and α3. The horizontal axis in FIG. 5 indicates theangular velocity ω of the camera, and the vertical axis in FIG. 5indicates the shutter speed Tv. 401, 402, and 403 denote the shutterspeeds Tv at the time of the background flow amount α2, the backgroundflow amount α1, and the background flow amount α3, respectively. 404denotes a threshold value of the angular velocity ω, and this thresholdvalue is provided in order to prevent a setting of the shutter speedfrom causing, through Equation (1), long exposure (e.g. for one secondor longer) when the angular velocity ω of the camera is small. If theangular velocity ω is smaller than or equal to the threshold value 404,the shutter speed Tv is set to a limit 405 (e.g. 1/15 seconds).

In step S212, the subject blur correction signal or the imagestabilization signal calculated in step S111 or step S116 is acquired.In step S213, it is determined whether or not the product of thecalculated shutter speed Tv and the calculated subject blur correctionamount or shake correction amount falls within a driving range of theimage stabilization system. If the product of the calculated shutterspeed Tv and the calculated subject blur correction amount or imagestabilization amount falls within the driving range of the imagestabilization unit 112, the processing proceeds to step S215, and thecalculated shutter speed Tv is set. On the other hand, if the product ofthe obtained shutter speed Tv and the calculated subject blur correctionamount or shake correction amount does not fall within the driving rangeof the image stabilization unit 112, the processing proceeds to stepS214, and the obtained shutter speed Tv is changed.

The change in the shutter speed Tv will now be described using FIG. 6.The horizontal axis in FIG. 6 indicates the zoom position, and thevertical axis in FIG. 6 indicates the driving amount [deg] of the imagestabilization system. A curve 501 shows a relationship between thedriving amount of the image stabilization system and the zoom position,and a broken line 502 denotes a driving limit of the image stabilizationsystem when the zoom position is telephoto-end. For example, if the zoomposition is telephoto-end, the shutter speed Tv calculated in step S209is 1/20 seconds, and the subject blur correction signal calculated instep S111 is 10 [dps], the driving amount required for imagestabilization is 0.5 [deg]. In a case where the driving limit 502 is 0.3[deg], a difference of 0.2 [deg] is a residual blur. For this reason, ina case where the driving amount required for image stabilization exceedsthe driving limit of the image stabilization system, the shutter speedTv is changed (from 1/20 seconds to less than 1/30 seconds) such thatthe driving amount of the image stabilization system falls within thedriving limit 502 thereof.

As described above, by automatically setting a shutter speed that fixesthe on-imaging plane moving amount on the imaging plane, even aphotographer who is not used to panning shooting can readily performpanning shooting.

Furthermore, since the shutter speed during panning shooting can be setusing the image stabilization system mounted in the image capturingapparatus, the present invention can be realized without increasing thenumber of apparatus components. However, even in a case of an imagecapturing apparatus that does not have an image stabilization system,the shutter speed during panning shooting can be set by providing anangular velocity detection unit. In this case, the shutter speed duringpanning shooting is set independent of whether image stabilization is ONor OFF in step S101 in FIG. 3A. Similarly, in a case of an imagecapturing apparatus having an image stabilization system as well,panning shooting may be performed when image stabilization is OFF, andat this time, control may be performed for setting the shutter speed bydriving the angular velocity detection unit 102.

Second Embodiment

First, a configuration and operation of an image capturing apparatusaccording to this embodiment will be described with reference to FIG. 8.FIG. 8 is a block diagram of an image capturing apparatus 201. In FIG.8, an optical unit 210 (imaging optical system) has a zoom lens 211, animage stabilization lens 212, a focus adjustment lens 213, a diaphragm214, and a shutter 215. A lens drive control unit 220 drives constituentmembers of the optical unit 210, and has a zoom control unit 221, animage stabilization control unit 222, a focus control unit 223, adiaphragm control unit 224, and a shutter control unit 225.

An image sensor 231 performs photoelectric conversion on an opticalimage formed via the optical unit 210, and outputs an analog imagesignal (image data). Operation timing of the image sensor 231 iscontrolled by an imaging control unit 232. An A/D converter 233 convertsthe analog image signal output from the image sensor 231 into a digitalimage signal. The digital image signal output from the A/D converter 233is stored in an internal memory 243 via an image input unit 234. Theimage input unit 234 is controlled by a memory control circuit 241. Theinternal memory 243 is controlled by a system controller 280. An imageprocessing unit 251 performs given pixel interpolation processing, colorconversion processing, and the like on data from the A/D converter 233(digital image data) or data from the memory control circuit 241. Thememory control circuit 241 controls the A/D converter 233, the imageprocessing unit 251, a compression/decompression circuit 242, and theinternal memory 243. The memory control unit 214 also controls recordingof data into a recording media 244.

Image data to be displayed that is written in the internal memory 243 isdisplayed by an image display unit 206, such as a TFT LCD display, viaan image display control unit 261. The internal memory 243 is used forstoring a shot still image or moving image, and is also available as awork area for the system controller 280. The compression/decompressioncircuit 242 is a circuit for compressing or decompressing image data.The compression/decompression circuit 242 reads an image stored in theinternal memory 243, performs compression processing or decompressionprocessing thereon, and again writes the processed data in the internalmemory 243.

The system controller 280 includes a CPU, an MPU, or the like, andcontrols the overall image capturing apparatus 201. A power button 202,a release button 203, a zoom key 204, and a menu operation key 205constitute an operation unit for inputting various operationinstructions for the system controller 280. The operation unit isconstituted by one of a switch, a dial, a touch panel, and the like, ora combination of some of these constituent members. A signal outputaccording to an operation made using the release button 203 is used as atrigger signal to operate the shutter to record a still image, or atrigger signal to start or stop recording of a moving image.

In this embodiment, the system controller 280 has a motion amountdetection unit 281, an exposure control unit 282, and a focal lengthacquisition unit 283. The motion amount detection unit 281 detects theamount of motion between two consecutively captured frames of images(i.e. between image frames acquired at different timings). In the secondembodiment, the motion amount detection unit 281 calculates motionvectors of a subject included in an image (an image corresponding to theimage data output from the image sensor 231). The focal lengthacquisition unit 283 acquires the focal length at the time of shooting.The exposure control unit 282 calculates the appropriate exposure valuebased on a luminance level obtained through photometry, and controlsexposure based on the calculated appropriate exposure value. In thisembodiment, the exposure control unit 282 controls the exposure periodbased on the motion vectors of the subject, vibration information, andthe focal length.

The system controller 280 drives the zoom lens 211 in the optical axisdirection to control the focal length based on a signal output accordingto an operation made using the zoom key 204. In this embodiment, thezoom control unit 221 calculates the zoom driving speed and the drivingdirection based on the direction and the amount of operation made usingthe zoom key 204 by the photographer, in accordance with an instructionfrom the system controller 280. The zoom lens 211 moves along theoptical axis in accordance with the result of this calculation. With asignal from the power button 202 being a trigger, the power control unit271 controls a power supply 272 so as to supply power to each part ofthe image capturing apparatus 201.

In this embodiment, for example, an image stabilization apparatus isconstituted by the image stabilization control unit 222 (vibrationdetection unit 2221) and the system controller 280 (motion amountdetection unit 281, exposure control unit 282, and focal lengthacquisition unit 283).

Next, a configuration and operation of the image stabilization controlunit 222 will be described with reference to FIG. 9. FIG. 9 is a blockdiagram of the image stabilization control unit 222. The imagestabilization control unit 222 corrects vibration by driving the imagestabilization lens 212 included in the optical unit 210 in a directionperpendicular to the optical axis. The vibration detection unit 2221included in the image stabilization control unit 222 has a vibrationdetection sensor, such as an angular velocity sensor for detecting theangular velocity (information regarding the angular velocity), anddetects (acquires) a signal (vibration information) of a camera shakeapplied to the image capturing apparatus 201. A vibration detection unit2221 a detects vibration of the image capturing apparatus 201 in thepitch direction. A vibration detection unit 2221 b detects vibration ofthe image capturing apparatus 201 in the yaw direction.

FIG. 10 is an illustrative diagram of the axes and directions of theimage capturing apparatus 201. In the image capturing apparatus 201, anoptical axis 1302 is parallel to a Z axis, and the pitch direction 1303p and the yaw direction 1303 y correspond respectively to a rotationdirection around an X axis and a rotation direction around a Y axis. Theroll direction corresponds to a rotation direction around the opticalaxis 1302 (Z axis).

Signals acquired by the vibration detection units 2221 a and 2221 b areconverted into digital signals via A/D converters 2222 a and 2222 b,respectively. Filters 2223 a and 2223 b eliminate low frequencycomponents whose frequency is lower than or equal to a given low cutofffrequency, from angular velocity signals obtained through conversionperformed by the A/D converters 2222 a and 2222 b, and output theresulting signals. The filters 2223 a and 2223 b also calculatevibration angles applied to the image capturing apparatus 201 byintegrating the angular velocity signals output from the A/D converters2222 a and 2222 b.

A target position calculation unit 2224 amplifies the vibration anglescalculated by the filters 2223 a and 2223 b, based on a zoom positionand a focus position, as well as a focal length and a shootingmagnification ratio that are obtained therefrom, and calculates a targetangle value. This is because image stabilization sensitivity on animaging plane to a stroke of image stabilization varies due to anoptical change, such as a change in the focal length or the shootingmagnification ratio. The target position calculation unit 2224calculates a driving amount of the image stabilization lens 212 based onthe target angle value. Note that the zoom position and the focusposition, as well as the focal length and the shooting magnificationratio that are obtained therefrom can be acquired via the systemcontroller 280.

A signal indicating a difference between the target position calculatedby the target position calculation unit 2224 and the current position ofthe image stabilization lens 212 acquired by image stabilization lensposition detection units 2227 a and 2227 b are input to a positioncontrol unit 2225. A driver 2226 supplies a driving currentcorresponding to the driving amount of the image stabilization lens 212to drive the image stabilization lens 212 in accordance with a signalthat is output from the position control unit 2225 to the driver 2226.

Next, a description will be given, with reference to FIG. 7, ofprocessing a case where a panning shooting assist mode is set in theimage capturing apparatus 201 according to this embodiment (i.e. amethod for controlling the image capturing apparatus). FIG. 7 is aflowchart showing a method for controlling the image capturing apparatus201 (image stabilization apparatus). Steps in FIG. 7 are executed basedmainly on instructions from the system controller 280 in the imagecapturing apparatus 201.

Initially, in step S701, the system controller 280 determines whether ornot the panning shooting assist mode is set in the image capturingapparatus 201. If the panning shooting assist mode is set, theprocessing proceeds to step S702. On the other hand, if the panningshooting assist mode is not set, the system controller 280 performsnormal image stabilization processing, and repeats the determination instep S701 until the panning shooting assist mode is set.

In step S702, the system controller 280 sets a background flow amountwhen panning shooting is performed. At this time, the photographer sets(selects) an arbitrary background flow amount via the operation unit inthe image capturing apparatus 201. The background flow amount can beindicated as levels such as large, medium, and small, for example. Toallow the background flow amount to be intuitively comprehended, thebackground flow amount level and a schematic image may be displayedtogether, or the proportion of the background flow amount to the overallangle of view may be displayed with respect to the respective backgroundflow amount levels.

Subsequently, in step S703, the system controller 280 starts servo AF.Servo AF allows the focus to continuously be on the subject. Note that,although servo AF is performed as a focus control method in the secondembodiment, the focus control method is not limited thereto and may beanother focus control method.

Subsequently, in step S704, the system controller 280 starts detectingmotion vectors. Here, the system controller 280 (motion amount detectionunit 281) detects (calculates) motion vectors from a live view imagethat is acquired at a given frame rate. For example, the motion amountdetection unit 281 sets search blocks obtained by dividing an image intoa plurality of regions, and detects a motion vector between images ineach search block.

In a case where two images acquired in time-series exist, the motionamount detection unit 281 divides the entire region of a first acquiredimage (image data) into a plurality of blocks (e.g. a plurality of imageblocks 1101 a in FIG. 11A). Next, the motion amount detection unit 281also performs the same processing on a second acquired image (imagedata) in the time series. The motion amount detection unit 281 thencompares an image block acquired first in the time series and an imageblock acquired second in the time series, and calculates similaritytherebetween. The motion amount detection unit 281 performs suchprocessing on the entire region while shifting the region to be comparedin the second image data, and determines the most similar region as adestination region. The motion amount detection unit 281 performs thisprocessing on all blocks in the image data, and calculates motionvectors in all blocks. This processing method is called a block matchingmethod, whereas motion vectors may be calculated using other methods.

The motion amount detection unit 281 constantly updates the thuscalculated value until immediately before exposure, unless thereliability thereof becomes lower than a given value. Thus, thecalculation result is reflected until immediately before exposure,enabling accurate panning shooting control during exposure.

Subsequently, in step S705, the vibration detection unit 2221 in theimage stabilization control unit 222 detects the angular velocityapplied to the image capturing apparatus 201 with respect to therespective axes. Subsequently, in step S706, the system controller 280determines whether or not the release button 203 is in a half-pressedstate (hereinafter denoted as “SW1_ON”). In a case of SW1_ON, theprocessing proceeds to step S707. On the other hand, in a case ofSW1_OFF, the system controller 280 repeats the determination in stepS707 until the release button 203 enters a half-pressed state (SW1_ON).

Subsequently, in step S707, the system controller 280 determines whetheror not the release button 203 is in a fully-pressed state (hereinafterdenoted as “SW2_ON”). In a case of SW2_ON, the processing proceeds tostep S708. On the other hand, in a case of SW2_OFF, the systemcontroller 280 repeats the determination in step S707 until the releasebutton 203 enters a fully-pressed state (SW2_ON).

Subsequently, in step S708, the system controller 280 (focal lengthacquisition unit 283) acquires the focal length at the time of shooting.Subsequently, in step S709, the system controller 280 (motion amountdetection unit 281) calculates a driving amount of the imagestabilization lens 212. A description will now be given, with referenceto FIG. 12, of a method for calculating the driving amount of the imagestabilization lens 212. FIG. 12 is a flowchart showing the method forcalculating the driving amount of the image stabilization lens 212.Steps in FIG. 12 are executed mainly by the motion amount detection unit281 and the image stabilization control unit 222.

Initially, in step S801, the motion amount detection unit 281 performshistogram processing based on the motion vectors detected (calculated)in step S704. A case where the calculated motion vectors are as shown inFIGS. 11A to 11C will now be considered. FIG. 11A shows the directionsof the motion vectors, FIG. 11B shows the values of the motion vectors,and FIG. 11C shows the result of performing the histogram processing onthe motion vectors. As shown in FIGS. 11A and 11B, in this embodiment,the entire region of the image is divided into a plurality of imageblocks 1101 a by the motion amount detection unit 281. Note that, inthis embodiment, motion vectors of only a horizontal movement in theimages are calculated to simplify the description, but this need not bethe case.

Subsequently, in step S802, the motion amount detection unit 281estimates the background moving amount based on the angular velocityapplied to the image capturing apparatus 201. A background moving amountA [pixel] can be obtained as indicated. by Equation (2) below.

A=f·tan(−ω/FR)/PP  (2)

In Equation (2), f denotes a focal length [mm], FR denotes a frame rate[fps], and PP denotes a cell pitch [mm]. Note that an angular velocity ω[rad/sec] can be acquired by the vibration detection unit 2221(vibration detection sensor).

Subsequently, in step S803, the motion amount detection unit 281performs processing for partitioning (separating) the motion vectors inthe image into background vectors (motion vectors of the background) andsubject vectors (motion vectors of the subject). If the backgroundmoving amount A obtained in step S802 is 5, it can be estimated thatvalues of sizes other than 5 are the subject vectors as shown in FIG.11C. Thus, the motion amount detection unit 281 extracts the subjectvectors from among the motion vectors. Note that, although, in thisembodiment, the background vectors are separated from the subjectvectors based on the angular velocity applied to the image capturingapparatus 201, this need not be the case, and the motion vectors in theimage may be separated into the background vectors and the subjectvectors by using other methods. Commonly, the photographer performsshooting while panning in order to keep the subject at one point withinthe angle of view. For this reason, larger motion vectors are output inthe background, and the motion vectors of the subject is output asamounts of residual blur. The motion vectors in the image may also beseparated into the background vectors and the subject vectors by usingthis tendency. It can be thus determined that regions that can beseparated as the background (background regions) are hatched portions inFIG. 11B, and the remaining portions correspond to the subject (subjectregions).

Subsequently, in step S804, the system controller 280 calculates thedriving amount of the image stabilization lens 212. The driving amountof the image stabilization lens 212 can be calculated from the subjectvectors. This is because, as mentioned above, the subject vectors arethe motion vectors corresponding to the amounts of residual blur, andeach correspond to a difference in the angular velocity in a case wherethe photographer has performed a panning operation. The imagestabilization control unit 222 corrects these amounts of residual blurwith the image stabilization lens 212 based on an instruction from thesystem controller 280, and performs control for stopping the movement ofthe subject. The amounts of residual blur can be corrected using adominant vector having the largest value among the subject vectors, forexample. Alternatively, the amounts of residual blur may be correctedusing an average value Va of the subject vectors. The flowchart in FIG.12 (step S709) ends here.

Subsequently, in step S710, the system controller 280 (exposure controlunit 282) sets exposure conditions. An exposure control method will nowbe described with reference to FIG. 13. FIG. 13 is a flowchart showingthe exposure control method. Steps in FIG. 13 are executed mainly by theexposure control unit 282.

Initially, in step S901, the exposure control unit 282 calculates afirst exposure period Tv′ [sec] based on the background flow amount thatis set in step S702, and the output from the vibration detection unit2221. Here, the background flow amount is denoted as X[%] relative tothe angle of view (which is set by the photographer in step S702), theangular velocity applied to the image capturing apparatus 201 is denotedas ω [deg/sec], and the focal length is denoted as f [mm]. The cellpitch of the image sensor 231 is denoted as PP [mm/pixel], the pixelsize in the vertical direction is denoted as Gv [pixel], and the pixelsize in the horizontal direction is denoted as Gh [pixel]. It is assumedthat the photographer is panning in the horizontal direction.

If the background flow amount is converted into a pixel number by usingthese values, a background flow amount B [pixel] can be expressed asEquation (3) below.

B=Gh×X×PP  (3)

The first exposure period Tv′ [sec] is expressed as Equation (4) belowby using the background flow amount B [pixel].

Tv′=C·B/(f·ω)  (4)

In Equation (4), C is an arbitrary constant.

Subsequently, in step S902, the exposure control unit 282 sets an upperlimit value of the exposure period (maximum exposure period) based onthe subject vector calculation result (motion vectors of the subject).Here, the upper limit value of the exposure period is denoted as asecond exposure period Tvm [sec]. The second exposure period Tvm can beobtained as follows, for example. Initially, the exposure control unit282 obtains the average value Va of the subject vectors from the resultshown in FIG. 11C. Next, the exposure control unit 282 obtains thelargest value Vm of the subject vectors. When a subject blur tolerancevalue (given tolerance value) is denoted as I [pixel], the secondexposure period Tvm needs to satisfy Conditional Expression (5) below.

(Vm−Va)×Tvm<I  (5)

Accordingly, the second exposure period Tvm is expressed as Equation (6)below.

Tvm=I/(Vm−Va)  (6)

Note that the subject blur tolerance value I can be any value, and maybe determined (changed) in accordance with a subject to be shot or ashooting scene.

Subsequently, in step S903, the exposure control unit 282 compares thefirst exposure period Tv′ calculated in step S901 with the secondexposure period Tvm calculated in step S902. If, as a result ofcomparing the first exposure period Tv′ with the second exposure periodTvm, the first exposure period Tv′ is shorter than the second exposureperiod Tvm (Tv′<Tvm), the processing proceeds to step S904, and theexposure control unit 282 sets the exposure period to be used inshooting to the first exposure period Tv′. On the other hand, if thefirst exposure period Tv′ is longer than or equal to the second exposureperiod Tvm (Tv′≥Tvm), the processing proceeds to step S905, and theexposure control unit 282 sets the exposure period to be used inshooting to the second exposure period Tvm.

Thus, in this embodiment, preferably, the exposure control unit 282controls the exposure period such that the exposure period does notexceed the maximum exposure period (second exposure period Tvm) obtainedin accordance with the motion vectors of the subject. More preferably,the motion amount detection unit 281 calculates, as the motion vectorsof the subject, the largest value Vm and the average value Va of themotion vectors at a plurality of positions in the subject. The exposurecontrol unit 282 then determines the maximum exposure period based on adifference (Vm−Va) between the largest value Vm and the average value Vaof the motion vectors. More preferably, the exposure control unit 282determines the maximum exposure period based on the difference (Vm−Va)between the largest value Vm and the average value Va of the motionvectors, and the subject blur tolerance value I determined in accordancewith the subject or the shooting scene (e.g. according to Equation (6)).Preferably, the exposure control unit 282 calculates the first exposureperiod Tv′ based on the vibration information and the background flowamount set by the user (step S901), and compares the first exposureperiod with the maximum exposure period (step S903). If the firstexposure period is shorter than the maximum exposure period, the firstexposure period is set as the exposure period (step S904), and if thefirst exposure period is longer than or equal to the maximum exposureperiod, the maximum exposure period is set as the exposure period (stepS905). Thus, by limiting the exposure period while giving considerationto the subject speed, it is possible to prevent excessive flow of thesubject and set an appropriate exposure period in accordance with thesubject.

Subsequently, in step S906, the exposure control unit 282 performsappropriate exposure calculation. A photometric value calculated here isdenoted as By (Bv value). Subsequently, in step S907, the exposurecontrol unit 282 calculates and sets an Av value and an ISO speed basedon the Bv value obtained in step S906, the exposure period (Tv value)set in step S904 or step S905, and a diagram for the panning shootingmood.

Here, Equations (7) to (10) below are used in exposure calculation.

Bv=Tv+Av−Sv  (7)

Tv=−log 2  (8)

Av=2 log 2  (9)

Sv=log 2(0.3×ISO speed)  (10)

The exposure control unit 282 sets the exposure value obtained thereby,and ends the flow in FIG. 13 (step S710).

Subsequently, in step S711, the system controller 280 starts exposure.Then, in step S712, the image stabilization control unit 222 drives theimage stabilization lens 212 while performing exposure, based on aninstruction from the system controller 280.

The image stabilization lens 212 is driven in accordance with thedriving amount calculated in step S709. In the second embodiment, theimage sensor 231 performs photoelectric conversion on the optical imageto output image data, while the image stabilization lens 212 is drivenin a direction perpendicular to the optical axis by the imagestabilization control unit 222 with the exposure period set in stepS710.

Subsequently, in step S713, the system controller 280 determines whetheror not the set exposure period has ended. If the exposure has not ended,the processing returns to step S712. If the exposure has ended, theprocessing proceeds to step S714. In step S714, the system controller280 (image stabilization control unit 222) restores the position of theimage stabilization lens 212 to its initial position.

According to the second embodiment, the exposure period obtained fromthe background flow amount is compared with the exposure period obtainedfrom the largest value of the subject vectors to limit the exposureperiod. Thus, it is possible to prevent the ambience brought out bypanning shooting from being lost due to the subject flowing. Note thatthe method for calculating the exposure period is not limited thereto.For example, a method of calculating the exposure period from adifference between a background vector and an subject vector may beused, or a method of calculating the exposure period from a differencebetween a motion vector of a focal point and an subject vector may beused.

The method for limiting the exposure period is not limited theretoeither. For example, a configuration may be employed in which anexposure period obtained by multiplying the first exposure period by aconstant is set, such that a panning shooting effect is caused toreliably appear regardless of the magnitude of subject vectors. Thus,even a photographer who is not used to panning shooting canautomatically set an exposure period with which movement of an subjectcan be stopped while letting the background flow, irrespective of thesubject. Accordingly, even an inexperienced photographer can readilyobtain a realistic panning image.

Portions of the above-described embodiments may be combined asappropriate. For example, the motion amount detection unit 281 maycalculate the smallest value of motion vectors at a plurality ofpositions in a subject as motion vectors of the subject, and theexposure control unit 282 may control the exposure period based on thesmallest value of the motion vectors. The motion amount detection unit281 may calculate motion vectors of a subject and motion vectors of thebackground included in an image, and the exposure control unit 282 maycontrol the exposure period based on the motion vectors of the subjectand the motion vectors of the background. The image stabilizationcontrol unit 222 can also correct vibration by driving the image sensor231, in place of the image stabilization lens 212, in a directionperpendicular to the optical axis. In this case, the image sensor 231performs photoelectric conversion on an optical image to output imagedata while being driven by the image stabilization control unit 222during a set exposure period.

With the image capturing apparatus according to the above embodiments,even a photographer who is not used to panning shooting canautomatically set an exposure period with which movement of an subjectcan be stopped while letting the background flow, irrespective of thesubject. Therefore, the above embodiments can provide an imagestabilization apparatus, an image capturing apparatus, a lens unit, animage stabilization apparatus control method, a program, and a storagemedium with which a realistic panning image can be readily acquired.

Other Embodiments

Embodiments of the present invention can also be realized by a computerof a system or apparatus that reads out and executes computer executableinstructions (e.g., one or more programs) recorded on a storage medium(which may also be referred to more fully as a ‘non-transitorycomputer-readable storage medium’) to perform the functions of one ormore of the above-described embodiments and/or that includes one or morecircuits (e.g., application specific integrated circuit (ASIC)) forperforming the functions of one or more of the above-describedembodiments, and by a method performed by the computer of the system orapparatus by, for example, reading out and executing the computerexecutable instructions from the storage medium to perform the functionsof one or more of the above-described embodiments and/or controlling theone or more circuits to perform the functions of one or more of theabove-described embodiments. The computer may comprise one or moreprocessors (e.g., central processing unit (CPU), micro processing unit(MPU)) and may include a network of separate computers or separateprocessors to read out and execute the computer executable instructions.The computer executable instructions may be provided to the computer,for example, from a network or the storage medium. The storage mediummay include, for example, one or more of a hard disk, a random-accessmemory (RAM), a read only memory (ROM), a storage of distributedcomputing systems, an optical disk (such as a compact disc (CD), digitalversatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, amemory card, and the like.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

This application claims the benefit of Japanese Patent Applications No.2016-012791, filed on Jan. 26, 2016, and No. 2016-012906, filed on Jan.27, 2016, which are hereby incorporated by reference herein in theirentirety.

What is claimed is:
 1. An image stabilization apparatus comprising: acalculation unit that calculates a motion vector of a subject includedin an image; an acquisition unit that acquires a focal length; and acontrol unit that controls an exposure period based on the motion vectorof the subject, vibration information detected by a detection unit, andthe focal length.
 2. The image stabilization apparatus according toclaim 1, wherein the control unit controls the exposure period such thatthe exposure period does not exceed a maximum exposure period thatcorresponds to the motion vector of the subject.
 3. The imagestabilization apparatus according to claim 2, wherein the calculationunit calculates, as the motion vector of the subject, a largest valueand an average value of motion vectors at a plurality of positions inthe subject, and the control unit determines the maximum exposure periodbased on a difference between the largest value and the average value ofthe motion vectors.
 4. The image stabilization apparatus according toclaim 3, wherein the control unit determines the maximum exposure periodbased on the difference between the largest value and the average valueof the motion vectors, and a subject blur tolerance value that isdetermined in accordance with the subject or a shooting scene.
 5. Theimage stabilization apparatus according to claim 2, wherein the controlunit calculates a first exposure period based on the vibrationinformation and a background flow amount that is set by a user, comparesthe first exposure period with the maximum exposure period, sets thefirst exposure period as the exposure period if the first exposureperiod is shorter than the maximum exposure period, and sets the maximumexposure period as the exposure period if the first exposure period islonger than or equal to the maximum exposure period.
 6. The imagestabilization apparatus according to claim 1, wherein the calculationunit calculates, as the motion vector of the subject, a smallest valueof motion vectors at a plurality of positions in the subject, and thecontrol unit controls the exposure period based on the smallest value ofthe motion vectors.
 7. The image stabilization apparatus according toclaim 1, wherein the calculation unit calculates the motion vector ofthe subject and a motion vector of a background included in the image,and the control unit controls the exposure period based on the motionvector of the subject and the motion vector of the background.
 8. Theimage stabilization apparatus according to claim 1, wherein thevibration information is information regarding an angular velocitydetected by an angular velocity detection unit serving as the detectionunit.
 9. The image stabilization apparatus according to claim 1, whereinthe control unit controls the exposure period if a panning shootingassist mode is set.
 10. An image capturing apparatus comprising: animage sensor that performs photoelectric conversion on an optical imageformed via an imaging optical system, and output image data; acalculation unit that calculates a motion vector of a subject includedin an image corresponding to the image data; an acquisition unit thatacquires a focal length; and a control unit that controls an exposureperiod based on the motion vector of the subject, vibration informationdetected by a detection unit, and the focal length.
 11. The imagecapturing apparatus according to claim 10, further comprising acorrection unit that corrects vibration by driving an imagestabilization lens included in the imaging optical system, in adirection perpendicular to an optical axis, wherein, in the exposureperiod, the image sensor performs the photoelectric conversion on theoptical image to output the image data, while the image stabilizationlens is driven by the correction unit.
 12. The image capturing apparatusaccording to claim 10, further comprising a correction unit thatcorrects vibration by driving the image sensor in a directionperpendicular to an optical axis, wherein, in the exposure period, theimage sensor performs photoelectric conversion on the optical image tooutput the image data while being driven by the correction unit.
 13. Alens unit comprising: an imaging optical system; a calculation unit thatcalculates a motion vector of a subject included in an image acquiredvia the imaging optical system; a detection unit configured to detectvibration information; an acquisition unit configured to acquire a focallength; and a control unit configured to control an exposure periodbased on the motion vector of the subject, the vibration information,and the focal length.
 14. A method for controlling an imagestabilization apparatus comprising: calculating a motion vector of asubject included in an image; detecting vibration information; acquiringa focal length; and controlling an exposure period based on the motionvector of the subject, the vibration information, and the focal length.15. A storage medium storing a program for causing a computer to executeprocessing for: calculating a motion vector of a subject included in animage; detecting vibration information; acquiring a focal length; andcontrolling an exposure period based on the motion vector of thesubject, the vibration information, and the focal length.